MODEL FOR PERSON PSYCHOEMOTIONAL STATE DETERMINATION USING AUDIO AND VIDEO DATA
نویسندگان
چکیده
Determination of the person’s psychoemotional state finds application in a variety tasks from diagnosis diseases to prevention emergency traffic situations. Given importance and where it used, there are many methods approaches exists, but most them use only one nonverbal feature, such as person's voice or facial expressions. At same time, simultaneous several signs can increase accuracy compared using sign. In this paper, method has been developed that uses expression signs. Based on literature review analysis existing methods, best were selected, was with solutions. The made possible improve CMCNN, at each test, Accuracy its own less comparison DisVoice + SVM. For improving weighted average proposed instead usual more complex model, which is able detect interrelation between expression.
منابع مشابه
Person Tracking Using Audio-Video Sensor Fusion
Motivation: Audio and video signals originating from the same source tend to be related. To achieve optimal performance, a tracking system must exploit not just the statistics of each modality alone, but also relationships between the two. Consider a system that tracks moving objects. Such a system may use video data to track the spatial location of an object. If an object emits sound, such a s...
متن کاملA Data Model for Audio-Video Data
Audio and video data have become critical components of information systems and these systems need to e ciently manage the large storage requirements of this type of data. However, there are no formal data models for audio video data. In this paper, we present an algebraic formalism which attempts to provide the underpinnings for the design and implementation of systems which organize and query...
متن کاملMultimodal Person Recognition using Unconstrained Audio and Video
We propose a person identi cation technique that can recognize and verify people from unconstrained video and audio. We do not expect fully frontal face image or clean speech as our input. Our recognition algorithm can detect and compensate for pose variation and changes in the auditory background and also select the most reliable video frame and audio clip to use for recognition. We also use 3...
متن کاملRobust Audio-Visual Person Verification Using Web-Camera Video
This thesis examines the challenge of robust audio-visual person verification using data recorded in multiple environments with various lighting conditions, irregular visual backgrounds, and diverse background noise. Audio-visual person verification could prove to be very useful in both physical and logical access control security applications, but only if it can perform well in a variety of en...
متن کاملParameter and State Estimation using Audio and Video Signals
The complexity of industrial systems and the mathematical models to describe them increases. In many cases point sensors are no longer sufficient to provide controllers and monitoring instruments with the information necessary for operation. The need for other types of information, such as audio and video, has grown. Suitable applications range in a broad spectrum from microelectromechanical sy...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Nau?nyj rezul?tat
سال: 2022
ISSN: ['2518-1092']
DOI: https://doi.org/10.18413/2518-1092-2022-7-3-0-5